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Abstract 

We address the following question: Can we expand an NIP theory 
by adding a linear order such that the expansion is still NIP? Easily, if 
acl{A)=A for all A, then this is true. Otherwise, we give counterexam- 
ples. More precisely, there is a totally categorical theory for which every 
expansion by a linear order has IP. There is also an w-stable NDOP 
theory for which every expansion by a linear order interprets bounded 
arithmetic. 

A well known open question is whether every unstable NIP theory inter- 
prets an infinite linear order. We are concerned here with a question somewhat 
in the same spirit but going in a different direction: Can we expand an NIP 
theory by adding a linear order on the whole universe so that the resulting 
theory is still NIPl We give a negative answer in two strong forms: 

1) There is an w-stable NDOP theory of depth 2 for which every expansion 
by a linear order interprets bounded arithmetic (see section |2^ . 

2) There is a totally categorical theory for which every expansion by a lin- 
ear order has IP. 



In the first section, we mention a few positive statements that are true (and 
easy): if M is NIP and acl(yl) = A for all A C M, then M can be linearly 
ordered so as to stay NIP. Also if M is cj-categorical, then M can be linearly 
ordered so as to stay w-categorical (a well known fact) so we cannot expect to 
get the strong conclusion of 1) with an w-categorical theory. 

*Thc author would like to thank the Israel Science Foundation for partial support of this 
research (Grant no. 710/07). Publication 979 on Shelah's list. 
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Let us also note that, as proved in [2] (using results from pQ), adding a 
predicate for a small dense indiscernible sequence preserves NIP. In particu- 
lar any unstable NIP theory T has an NIP expansion which defines an infinite 
linear order. 

As far as we know, the question we address was first asked by Artem 
Chernikov. It came up again in discussions with Udi Hrushovski, which led 
to this work. We would like to thank him for that and for helping the second 
author understand the results of the first author. 

1 The easy case 

We fix a one-sorted relational language C not containing the symbol <, let £< 
be the language with a unique binary relation < and let C = CVJ £<. Let T 
be a complete £-theory that eliminates quantifiers. Let T' be the £'-theory 
generated by T and axioms stating that < defines a dense linear order with no 
end-points. 

We show in this section that if T eliminates 3°°, then T' has a model- 
companion. Apart maybe from Proposition II. 4[ everything here is well known. 
We follow the exposition of |6] which contains exactly what we need. The 
cj-categorical case was already observed by Schmerl in [S]. 

Let M be any structure, and A (Z M a, finite subset. We say that a formula 
Xn) with parameters in A is large if it has a solution ai, such that 
for all i 7^ j, ^ acl(yl) and Oj 7^ aj. If x„; y) is a formula, then using 

elimination of 3°°, it can be checked that the set of (i's such that x„; d) 

is large is definable (Fact 2 of 

Proposition 1.1. Let T he any C-theory that eliminates quantifiers and 3°°. 
Then T' admits a model- companion T axiomatized by T along with the state- 
ments saying that for every large C-formula 0(xi,..,x„) and quantifier-free 
large C^-formula 9{xi, ...,Xn), the conjunction (f){xi, ...,Xn) A 9{xi, ...,Xn) has 
a solution. 

Furthermore, in T, the type of an algebraically closed set is given by the 
union of its C-type and its C^- quantifier- free-type. 

Proof. The first statement is a special case of Lemma 8 of [6]. The proof 
is straightforward: any model of T' embeds into a model of T by iteratively 
adding solutions to formulas. Existential closeness is clear. 
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The second statement is by easy back-and-forth. 



□ 



Corollary 1.2. Let M \= T be an C-structure, and assume that algebraic 
closure is trivial in M: a.c\{A) = A for all A C M. Assume that M admits 
elimination of quantifiers in C. Then there is an expansion T' of T to C = 
CU{<} such that < defines a linear order andT' has elimination of quantifiers 
in CJ . 

Proof. Take T as above. As acl(A) = A for all A C M, the type of any set A is 
given by its £-type and its quantifier-free £<-type. As T eliminates quantifiers 
in C, T eliminates quantifiers in C. □ 

Conclusion 1.3. 1. If T is u- categorical, then T admits an u- categorical 
expansion to CJ in which < defines a linear order. 

2. If T has trivial algebraic closure and is NIP, then it admits an NIP 
expansion to C in which < defines a linear order. 

Proof. The second point follows from the Corollary. 

For the first point, notice first that any cu-categorical theory eliminates 
3°°. More precisely, for finite A, a.c\{A) is finite. So for a given integer n, the 
type of an n-tuple a = (ai, a^) in a model of T is given by its £-type and 
the ordering of acl(a). We see that there are only finitely many possibilities. 
Therefore T is w-categorical. □ 

We end this section with a small observation. 

Proposition 1.4. Assume T eliminates 3°°. Let M \= T. If all infinite 
definable sets of M has the same cardinality X, then M admits an expansion 
to a model M' of T as defined above. 

Proof. Fix a A saturated dense linear order <n) without end points. We 
will build an injection / : M — f2. Fix an enumeration {aa : a < A) of all pairs 

= (0a(a;i, 6a{xi, whcre G £(M) is large and 6{x) is an 

£<-quantifier-free formula with parameters in M. We build / by induction on 
a < A so / will be defined as an increasing union / = Ucka/q, where each fa 
has domain a subset of M of size | a | . 

At limit stages, set fa = ^i3<afi3- 

Assume fa has been defined. Let A be the set of parameters of 9a- If 
needed, start by increasing fa to an injection /' defined on Dom{fa) U A by 
defining it on A in an arbitrary way. Let 9' be the formula built from 9a 
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changing every parameter by its image by If 9' is not large (in particular if 
it is inconsistant), we let = /'. 

Otherwise, we can find a tuple a = (ao, fln-i) in M such that M \= (j){d) 
and no is in the domain of /'. Pick any c = (cq, ...,c„_i) in Q, such that 
Q \= ip{c) and no Ck is in the range of We define fa+i as /' U {(ofc, Ck) ■ k < 
n}. 

Once / is defined, we expand M to C by letting a < 6 if and only if 
/(a) <n fip). By construction the resulting structure is a model of T. □ 

2 Counterexamples 

2.1 Fp vector space 

We prove the following result. 

Theorem 2.1. If T defines an infinite dimensional vector space over some 
prime field Fp, and T is linearly ordered by <, then T has IP. 

First we need to recall the following Ramsey- type result. See for example 
[4], Section 2.4, Theorem 9. 
Here F is a fixed finite field. 

Theorem 2.2. For all r,t,k > 1, there is some n such that if the t-dimensional 
affine subspaces of are r-colored, there exists a k-dimensional affine sub- 
space all of whose t-dimensional affine subspaces have the same color. 

Now we prove Theorem 12.11 

Proof. We identify F = ¥p with the set {0, 1, ...,p— 1} and order F by setting 
< 1 < ... < p - 1. 

Without loss, T is just an ordered vector space over F. Let M \= T and pick 
an infinite free family {ai : i < u). Let k be any integer and set t = l,r = p\. 
Finally, let n be given by Theorem [22] for those values of r, t, k. We consider the 
vector space A spanned by (ai, a„) and identify it with using (ai, a„) 
as canonical base. Let @ be the lexicographic order on A (identified with F"). 

Let L C A be an affine line in A, L = {do, dp-i} with rfo ©c^i @ ... @ dp-i. 
We assign to L a 'color' c(L) from the set S of permutations of F in the 
following way: c(L) is the unique permutation vr such that 

d^o) < < .... < (i^(p_i). 
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where < is the given order on M. 

By Theorem \2.2\ we can find a /c-dimensional affine subspace W oi A all 
of whose 1- dimensional affine subspaces have the same color tt. Let (fe^, h^) 
be a basis of VectiW) such that for each I < k, ^ is ©-minimal in Vect{W) \ 
Vect{b^, .., b^~^). For each I < k, let ui be the least i such that the i'th coordi- 
nate of 6' (in the basis (ai, a„)) is non zero. We have 

UJi> UJ2> ... > OJk 

and for each choice of s = (si, s^) G -F'^, there is a unique element of W 
such that for every i, the Wj'th coordinate of is equal to Sj. For / C {1, k}, 
let (i/ be for s = (ei,/, ....,ek,i) where Eij = 1 if i G / and otherwise. 
We let (j).^{x,y) be the formula: 

p-2 

(l)„{x, y) = /\x + n{i).y < X + 7r(z + l).y. 

i=0 

Let / C {1, k} and / < k. Consider the line L = dj + Vect{b''). Enumer- 
ating L in @ increasing order gives 

di - eijb^ ©di- eijb^ + 6' @ ... © dj - eijb^ + {p - 

As L has color tt we see that (pT^idi, holds if and only if eij = 0. This 
proves that the formula </)^(x,?/) has independence rank at least k. As k was 
arbitrary, and there are only finitely many possibilities for vr, there is at least 
one value of vr for which ^^^(x, y) has IP. 

□ 

Remark 2.3. In the case p = 2, the same proof works if instead of assuming 
that < defines a linear order, we only assume that it defines a tournament {i.e., 
for all X 7^ ?/ G M, exactly one of x < y and y < x holds). 

2.2 Interpreting arithmetic 

By bounded arithmetic, we mean the (incomplete) theory Tarith consisting of 
formulas true in almost all structures ({0, n}; -|-, x). A model interprets 
bounded arithmetic if it has an elementary extension that interprets a model 

of Tarith- 
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Theorem 2.4. There is an u-stahle theory T , NDOP of depth 2, in a language 
C such that: for every model M \= T and every expansion M' of M to C = 
CU {<} in which < defines a linear order, M' interprets bounded arithmetic. 

We take as language £ = {E, S, R} where E and S are binary predicates 
and R is quaternary. The predicate E defines an equivalence relation on the 
structure and each i?-class is a made by {S, R) into a regular colored graph as 
explained later. 

We will define T, by constructing its prime model Mq built as a disjoint 
union of finite regular graphs. Each of those graphs will be exactly one E- 
class. The n'th graph will contain no cycle of length < n. We will choose the 
finite graphs in such a way that no mater what order is put on them, the n'th 
graph interprets ({1, ...,n}, +, x), by an explicit formula not depending on n. 
The condition about cycles will ensure that the limit theory of those graphs is 
w- stable. 

The first observation is that, for every n, there is a structure ({1, .., A^}, <i 
, <2) where both <i and <2 are linear orders (call this a bi-order) that inter- 
prets ({1, ra}, +, x). Furthermore, the formulas involved in the interpreta- 
tion do not depend on n. This is an easy exercise whose solution is given in 
the appendix. As a consequence, the problem is reduced to that of interpreting 
two linear orders. 

We will work with colored graph. For us a colored graph is a structure 
{G;S,R) where S{x,y) is symmetric anti-refiexive and R{xo,yo,xi,yi) is a 
quaternary relation which defines an equivalence relation on pairs (x, y) G S. 
It should be thought of as saying that {xq, yo} and {xi,yi} are two edges in the 
graph of the same color. We will consider only regular colored graph, namely 
such that each vertex is part of exactly one edge of each color. For simplicity, 
we will introduce the imaginary sort C of colors defined by the quotient of 
{{x,y) G :|= S{x,y)} by the equivalence relation {xo,yo)E{xi,yi) <^=^ 
R{xo,yo,Xi,yi). If A; G C is a color and x G G is a vertex, by the /c-neighbor 
of X, we mean the unique y & G such that {x, y} is an edge of color k. 

Denote by Ccg the language {5", R} of colored graph. We will use C'^g to 
denote the expanded language {S,R,<} where < is a binary predicate. Also 
let ^{x,y,u,v) be the C'^g formula saying that {u,v} is an edge and if k is its 
color, then the /c-neighbor of x is <-less than the /c-neighbor of y. 

In the rest of this subsection, we prove the following proposition. 
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Proposition 2.5. Let N,c> 3 be integers, let also <i, <2 be two linear orders 
on N = {0, — 1}. Then for every even integer n big enough, there is a 
finite regular colored graph Gn on n vertices such that for every expansion of 
Gn to C'l^g making < into a linear order, there are a, b, u, v G Gn such that the 
structure ([a, 6]; <, y, u, v)) is isomorphic to {N; <i, <2). Furthermore, Gn 
has no cycle of length < c. 

Here [a, b] denotes the interval with end points a and b in the sense of <. 

We will build the graph G„ by a random procedure and show that with pos- 
itive probability, we obtain what we want. Actually, we will start by building 
a colored multigraph G{a) and then modifiy it to make into an actual regular 
graph G'{a). By a colored multigraph, we mean a colored graph in which there 
can be two or more edges (of different colors) between two given vertices. 

Let n be even and big enough (we will see during the construction what 
big enough means). Fix some 1 — ^ < a < 1 and let d = n^~". We take 
n = {0, n — 1} as set of vertices and C = {0, d — 1} as set of colors. So 
our final graph will be d-regulai. 

Let (3„ denote the symmetric group on n elements. Our space of events is 
Q = equipped with the uniform probability law. Let a = {ai : i < d) he an 
element of Q. We define a colored multigraph G{a) as follows: The vertex set 
of G{a) is {0, ...,n — 1}. The set of colors is {0, ...,d— 1}. For k < d, we draw 
an edge of color k between vertices a and b if and only if for some I < n/2, we 
have {afc(2/), orfc(2/ + 1)} = {a, b}. 

A cycle of length r > 2 is a sequence (ao, ...,0^-1) of distinct vertices and 
a sequence (cq, e^-i) of distinct edges such that for each i < r, Ci is an edge 
between and Oj+i (addition is modulo r). In particular, a cycle of length 2 
in G{a) is given by two vertices and two different edges linking them. A cycle 
is said to be small if it is of length < c. 

If G C is a color, we define <k hj x <k y H and only if the /c-neighbor of 
X is <-less than the fc-neighbor of y. We will show that each of the following 
events occurs with probability converging to 1 as n tends to +00: 

1. The number of small cycles in G{a) is less than c?^'^, and we can obtain a 
regular graph G'{a) with no small cycles by changing at most 2.d'^'^ edges 
of G(a), 

2. For every ordering < of the vertices of G'(cr), we can find at least d^'^ values 
of (a, b,k) E G"^ X C such that ([a, 6]; <, <k) is isomorphic to (A^; <i, <2). 
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2.2.1 Removing small cycles 



We perform some surgery to remove small cycles from the multigraph G{a) 
and obtain a regular graph G'{a) with no small cycles. 

We compute the expectancy of the number of small cycles in G{a). Let 
2 < s < c. Let H = {Vh,Eh) be the graph consisting of a unique cycle of 
length s. Fix some f : Vh ^ {0, ...,?7, — 1} injective and some g : — )■ 
{0, ...,d — 1}. Assume that for any two edges e,e' G Eh having a vertex in 
common, g{e) ^ g{e'). Call such a pair (/,(?) a subgraph of G{a) if for every 
edge e = {a, b} G Eh, {/(a), f{b)} is an edge of G{a) and has color g{e). For 
a given edge e, the probability pq that this occurs is 



If g is injective, then all those events are independent, so the probability p 
that (/, g) is a subgraph satisfies 



If g is not injective, the events are not independent, but nevertheless, looking 
color by color, the same estimate can easily be seen to be true. 

The number of such pairs (/, (?) is less than ra^d*. So the expected value of 
the number of cycles of length s is asymptotically at most 



Let X denote the number of small cycles in G{a). Summing over all s < c, 
we see that E{X) = 0{l).d'^. By the first moment method 



In particular, with probability converging to 1 at n tends to +oo, the number 
of small cycles in G{a) is less than d'^'^. Consider a a that has that property. 

We now modify the graph G{a) so as to remove all small cycles. We show 
that this can always be done by changing at most 2.d^'^ edges. 

Consider each small cycle one after the other. Let G be such a cycle, of 
size s < c. Pick any edge {a, b} in G. Assume it is drawn with color k. We 
will choose an edge {a', b'} drawn with color k, erase both those edges, and 



1 



Po = 



- 1 



n 





Prob{X > d^^) < 0(1). ci-^ 
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draw instead, with color k, the edges {a, a'} and {h,h'}. We have to choose 
{a', h'} so that no new small cycle is introduced. It is easy to check that this 
will happen if the following two properties are satisfied: 

- the graph distance between a and a' is at least c + 2, 

- the edge {a', h'} does not belong to a small cycle. 

Note that the first condition implies that the distance between h and h' is 
at least c. We see that the number of edges {a', 6'} which fail to satisfy those 
properties is at most 0{l).{d'^^'^ + d?'') < n, so we can find a', b' as required. 

In the end, we have modified at most 2(P'^ edges. Call G'{a) the graph 
obtained at the end of the surgery. 

2.2.2 Interpreting bi-orders 

All is left to prove is that if (A^; <i, <2) is given in advance, we can interpret it 
with high probability in G{a) (uniformly in A^) in many different ways. This 
will automatically imply that we can also interpret it also in G'{a). 

Recall that the binomial distribution with parameters n, p is defined as the 
distribution of the sum of n independent random variables being equal to 1 
with probability p and to with probability 1 — p. We will need the following 
fact about binomial distributions. It is a special case of Hoeffding's inequality 
(or of Chernoff's bound). See for example [3]. 

Lemma 2.6. Let X be a random variable whose law is a binomial distribution 
with parameters n,p. Then for any x we have: 



We are given a fixed structure (A^; <i, <2). Let < be any order on {0, n — 
1} (the set of vertices of G{a)), without loss, the usual order. Given a < n and 
k & G a. color, define the event Sa.k as 



Fix a value of k. Let D C {0, ...,n — 1} be a subset of size < n/4N closed 
under taking the fc- neighbor. Assume we know the values of crk{x) for every 
X E D and the values of ai{x) ioi I < k and every x. Take some a < n such 
that D n {a, a + l,...,a + A^— 1} = 0. We look at the values of the /c- neighbors 
of the points {a, a + 1, a + A^ — 1}. With probability > 1/2 those neighbors 



Prob{X <x) < exp -2 




([a, a + A^ — 1]; <, <k) is isomorphic to (A^; <i, <2). 
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are disjoint from {a, a + 1, ...,a + — 1} so we are considering 2N distinct 
points. Consider the bi-order ([a, a + — 1]; <, <fc). Clearly, all A^! bi-order 
have the same probability of occurring. So, knowing ak restricted to D and ai 
for / < k, the event £a,k holds with probability at least 

Assume we know the values of ai for / < k. We start with Dq = 0, take 
Oo = 0. With probability at least the event £^ao,fc holds. Next we let Di 
contain {a^, ao + 1, ao + A^ — 1} and all /c-neighbors of those points. We take 
some ai as in the previous paragraph. Again with probability at least Sa^^k 
holds. We can iterate this at least times (as D increases by at most 2N 
each time). We do this for each color, one color after the other. Let Y be the 
number of events Sa^k that hold. Then for every x, 

Prob{Y <x)< Prob{B < x) 

where i? is a random variable whose law is a binomial distribution with pa- 
rameters^^. 

By 12. 6t the probability that at least d^^ of the events £a,k succeed is at least 

( dn _ fpc\2 



1 - exp |^-l6Ar^ ^i6^^^^^ ' j = 1 - exp (-n2-".0(l)) , 

As there are n\ < exp(r;,lnn) different orders on {0, ...,n — 1}, we see that 
with probability converging to 1 as n tends to +00, for every ordering < of the 
vertices, there are at least d^'^ values of {a, k) ^ n x C for which 

([a, a + N — 1]; <, <k) is isomorphic to (A^; <i, <2). 

In particular, if furthermore G{a) has less than d'^'^ small cycles, there is a 
choice of (a, k) such that no edge of color k having an end point in {a, a + 
A^ — 1} is changed during the construction of G'{a). Therefore with this choice 
of (a, /c), we obtain an interpretation of (A^; <i, <2) in G"(cr) as 

{[a,a + N -ll<,<^{x,y,u,v)) 

where {m, f } is any edge of color k. 
This ends the proof of I2.5[ 

2.3 The full structure 

We now conclude with the proof of Theorem 12.41 
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We recall that we set C = {E, S, R} where E is a. binary relation. Fix 
an 3 < n < w. Let (A^;<i,<2) be the structure P„ given by 12. 7[ Let also 
[Gn] S, R) be the colored graph given by Proposition 12. 51 with c = n. We define 
the £-structure Mq as follows. The reduct to {S, R} is just the disjoint union 
of the graphs {Gn]S,R). The predicate E is interpreted as an equivalence 
relation, such that two points x, y G Mq are -E-equivalent if and only if they 
come from the same On- 

What does T/i(Mo) look like? Let M be elementary equivalent to Mq. 
Then in M, E defines an equivalence relation which has u finite classes. The 
substructure of M formed by the union of those finite classes is isomorphic to 
Mq. An infinite class of M, equipped with {S,R) is a regular colored graph 
with no cycles and infinite degree. So as a graph, it is a union of trees. Finally, 
there are no S'-relations between points in different classes. 

We see that to every E class are associated two regular types: one for a new 
connected component and one for a new color. The type of a new E class is 
itself a regular type. A model is entirely determined up to isomorphism by the 
number of infinite i?-classes and for each such class, the number of connected 
components and the number of colors. So easily, the resulting theory is u- 
stable, NDOP of depth 2. 

Finally, if < is an expansion of Mq by a linear order, then in the /c'th equiv- 
alence class, we can interpret ({0, /c}; +, x), uniformly in k. In particular 
the expansion interprets bounded arithmetic. 

Appendix: interpreting arithmetic from two lin- 
ear orders 

The following is certainly well known, but we include it for completeness. 

Proposition 2.7. There are formulas (j){x, y, z; t), tp{x, y, z; t) in the language 
C = {<i, <2} such that for each k < u, there is an C-structure satisfying : 

• <i and <2 define linear orders on Pk, 

• there are ao,ai,a in Pk such that the structure 

([ao, ai]2; 0(a:, y, z; a), y, z; a)) 

is isomorphic to ({0, A; — 1}, +, x). 

(where [a, 6)2 denotes the interval a <2 x <2 b). 
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Proof. Let k < u and set n = 10. k"^. Let Pk have universe {0, ...,n — 1} and 
let <i be the usual order on that set. For i G {0, k — 1}, let 6j = 7k. {i + 1). 
Let ai = bk-i- The points of Pk greater then bk~i will be called delimiters. 

Now we construct <2 in the following way : an initial segment is bo <2 bi <2 
... <2 bk~i. Those points will correspond to {0, .., A; — 1} in the interpretation. 
For I < n, r < k we say that / codes for r if 6^-1 < I < br (setting 6_i = — 1). 
Now we encode the graph of addition. Let (ylj)j<jv be an enumeration of all 
triples (r, s,t) G {0, .., k — 1}^ such that r + s = t. Build a map f : N ^ P^ 
such that for each z < A^, if f{i) = (c^, c^, q, d) then Cr, Cg and q code for r, s, t 
respectively and = ao+^ + 1 is a delimiter. Also impose that no point appears 
in two tuples /(i), f{i') for i ^ i' . Now set <2 such that <2 <2 Q <2 each 
time /(i) = (cr, Cs, Q, (i), and those four points form a interval of <2. Place 
those intervals one after another in any order. Let a2 be the last delimiter 
placed. Next do the same for the graph of multiplication, and let as be the last 
delimiter placed there. Finally place the elements that are left in any order 
after 03. 

Now it is easy to check that one can interpret ({0,...,fc — 1};+, x)in this 
structure, with parameters 01,02,03, and that the formulas involved do not 
depend either on the choices made nor on k. 

□ 
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